EuropSisches European Office europeen 

Patentamt Patent Office des brevets 



REOV 26 OCT 2004 



WlPO POT 



Bescheinigung Certificate Attestation 



Die angehefteten Unterla- 
gen stimmen mit der 
ursprQnglich eingereichten 
Fassung der auf dem nSch- 
sten Blatt bezeichneten 
europdischen Patentanmel- 
dung Qberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fix6s k 
cette attestation sent 
conformes d la version 
initialement d6pos6e de 
la demande de brevet 
europ<§en specifite d la 
page suivante 



Patentanmeldung Nr. Patent application No. Demande de brevet n° 

03104022.3 

! PRIORITY 
: DOCUMENT 

SUBMITTED OR TRANSMITTED IN 
\ COMPLIANCE WITH RULE 17.1(a) OR (b) 



Der President des EuropSischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de I'Office europeen des brevets 
p.o. 



R C van Dijic 




Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Anmeldung Nr: 

Application no.: 03104022.3 
Demande no; 



Anmeldetag: 
Date of filing: 
Date de d^pdt: 



30.10-03 



Anmel der/AppI IcantC s)/Deinandeur( s) : 

Koninklijke Philips Electronics N.V- 
Groenewotidseweg 1 
5621 BA Eindhoven 
PAYS-BAS 



Bezelchnung der Erf Indung/Tltle of the 1 nventi on/Tl tre de !■ Invention: 
(Falls die Bezelchnung der Erflndung nicht angegeben 1st, slehe Beschr^l bung. 
If no title Is shown please refer to the description. 
SI aucun titre n'est IndlquS se referer ft la description.) 

Method of predicting input 

In Anspruch genommene PrIorlHtCen) / PrIorltyCles) claimed /Pr1or1t6(s) 
revendlqu^eCs) 

Staat/Tag/Aktenzelchen/State/Date/Flle no./Pays/Date/Num^ro de d€pdt: 



Internationale Patentklasslflkat Ion/International Patent Classification/ 
Classification Internationale des brevets: 

G06F17/30 

Am Anmeldetag benannte Vertragstaa ten/Contracting states designated at date of 
flllng/Etats contractants d^slgn^es Tors du d^pot: 

AT BE B6 CH CY CZ DE DK EE ES FX FR 6B 6R HU IE IT LU MC ML 
PT RO SE SI SK TR LI 



03104022.3 
EPA/EPO/OEB Form 1014.2 - 01.2000 



7001014 



2 



PHNL031279EPP 



1 16.10^003 

Method of predicting input 



FIELD OF THE INVENTION 

The present invention relates to methods of predicting input of electronic 
objects, for exanq)le enhanced messaging service (EMS), multimedia message service 
^MMS), or e-mail objects, in communication devices. Moreover, the present invention also 
5 -relates to conamunication devices, for example mobile telephones or Internet-connected 
personal computers, operating according to the method. 

BACKGROUND TO TEE INVENTION 

Communication devices such as mobile telephones are weU known and in 

10 general used worldwide. Earlier mobile telephones were arranged to support substantially 
speech communication. On account of improvements in display &cilities of mobile 
telephones, far exaxaple on account of the incorporation of back-lit liquid crystal pixel matrix 
displays therein, it has more recendy become increasingly common for mobile telephone 
users to communicate by way of text messages. Moreover, it has become popular to include 

IS other types of information-conveying gr^hical synobols popularly known as "emoticons**. 

An emoticon is defined as a hieroglyphic character that is formed using a 
plurality of typical characters or special characters in combinaticm to reproseut a nrabile 
telephone user's emotions. The term "emoticon" is a compound word of "emotion" and 
"icon". Emoticons are part of a language unique to <^ber space, by which emotions, 

20 symbols, personalities, jobs and physical maocoscopic items are represented by using 
characters, symbols and digits available on the keyboard of a con^uter or digital 
cominunicating device such as a znobile telephone. They are widely used in cyber space 
since tiiey are easily understood and easily &cilitate a desciq)tion of an esqpression of subtle 
emotions of a user. 

25 The preparation and transnussion of emoticons are knowQ. For exanq^le, in a 

United States patent application no. US2002/007713S, there is described a method of easily 
icputting CTioticoos. In the rnetfaodiirplemented in a mobile terminal, for exanqile a mobile 
telephone, a plurality of emoticons are formed by utilizing a plurality of typical characters 
and special characters in combination; the emoticons are grouped and stored by groiqis in the 
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mobile tenninal. The mobfle terminal is ananged to be susceptible to entedng into an 
emoticon inpiit mode of operation, displaying the stored emoticon groups, displaying the 
emoticons of an emoticon group selected by a user, and transmitting a short message system 
(SMS) m^sage including at least one emoticon selected by tiie user. 

Moreover, in a published international PCT patent application no. 
PCT/US02/24647 (WO 03/017681), tiierc is described an apparatus, such as a 
communication device, which is provided with emoticon hspxA logic associated with an input 
key to improve tiie ease-of-use of the apparatus for entering emoticons, for example into a 
text message, whilst the apparatus is operating, for example in a text mode. Resjjonsive to a 
selection of the associated input key, one or more emoticons are displayed for selection, A 
user may "scroll" the one or more displayed emoticons to "select" an emoticon. In one 
example apparatus described, current focus is placed on one of the displayed emoticons, and 
the emoticon with tiie current focus is automatically selected upon elapse of a predetermined 
amount of time after the current focus was placed. 

The inventor has ^reciated that, despite attempts in the prior art to make 
emoticon entry easier, it is still a laborious and often tedious task to include emoticons in 
m^sages, especially when using miniaturized equipment such as contemporary mobile 
telephones. In order to render such data entry potentially easier, iJie present inventor has 
devised tiie present inventicm. 

SUMMARY OF THE INVENTION 

» A first object of tiie present invention is to provide a metiiod of predicting 
input of electronic objects, for example enhanced messaging service (EMS) or multimedia 
messaging s^ce (MMS) objects, in communication devices, for exsanple mobile 
telephones. 

A second object of the invmtion is to provide a communication device 
implemmting a metiiod of predicting input of electronic objects, for example EMS or MMS 
objects, to render tiie device easier to use. 

According to a first aspect of the jiresent invention, there is provicted a metiiod 
of predicting input of electronic objects in a communication device, flie metiiod including the 
steps of: 

(a) establishing a first database of electronic objects susceptible to being inserted 
into multimedia messages composable on the device; 

(b) establishing a second database of eledronic object attributes; 
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(c) establishing one or more associations belween at least one object of the first 
database and at l^t one corresponding attribute of the second database; 

(d) receiving fiom a user of the device a request for inclusion of one or more of 
the objects into a multimedia message, said request including at. least one input argument; 

5 (e) matching said at least one input argument with said at least one attribute in the 

second database and thereby identifying one or more objects corresponding to the at least one 
inpiit argument and its associated at least one attribute; and 

(Q presenting to the user a display representation of said one or more objects 

corresponding to said at least one argument 
10 The invention is of advantage in that it is capable of predicting input of 

electronic objects, for example in mobUe telephone devices. 

It will be appreciated in step (d) that a request for inclusion of one or more of 

the objects can be either implicit or explicit For exanoqple, it may be a defoult fimctioa of the 

communication devicei, for exanqile time and/or temperature and/or spatial location; 
IS altemadvely, the request can be esqilicit corresponding to the user actively inputting the 

request; for example by way of a keyboard of the device and/or by way of voice-activated 

hspaL 

Preferably, said one or more identified objects fiom step (e) are presented in a 
prioritised mamier relative to otfaor objects in the first database. Such a jnioritised manner is 
20 capable ofdrcumventing a need for the user to search through all electronic objects provided 
on tlie&vice but merely a sub-set thereof. More preferably, said one or more identified 
objects fixim step (e) are presented firstly to the user. In other words, electronic objects are 
preferably present to the user in a descending order of relevance. 

Preferably, said one or more identified otgects from step (e) are presented in 
25 an order wherein objects with most matching attributes to said one or more arguments are 
presented firstly in progressive order to those objects with least matching attributes to said 
one or more arguments. 

Preferably, at least one of the objects of the first database is associated vTith a 
plurality of correspondiiig attributes in the second database. 



30 Pteferably, said one or nK>re attributes include at least one o£ 

(a) relationship of the user to one or more intended recipients of the message; 

(b) a degree of desired informality of said message; 

(c) chronological time of at least one of an instance of generation of the message 



and an instance of despatch of said message; 
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(d) ambient conditioiis of the user whea composing the message, said conditions 
including at least one of andnent illumination intensity, ambient tenatperatOFe, ambient 
humidity, ambient altitude; 

(e) geogr^hical spatial location of the user when at least one of composing and 
S sending the message; 

(Q location of the user according to ftmction of the location; 

(g) a previous history of a preferred selection of said one or more objects 
exercised by tiie user; 

(h) at least one of a telephone number and a cyberspace address of said one or 
10 more intended recipients for the message; and 

(i) a one word already part of the message. 

Preferably, in the method, die device includes position measuring means for 
determining its geographical spatial location. More preferably, said measuring means 
includes at least one of an A-GPS and an E-OTD measuring ajiparatos. 
IS Preferably, in the method, the device is operable to relate the geographical 

spatial location to the user location according to location fimction. Such association mables 
the device to select automatically a subset of suitable objects depending on location without a 
need for the user the enter spatial location data into the devices, thereby rendering the device 
easier to use. Location fimction includes, for exaniple, "home", "work", "club", "mistress* 
20 bedroom" and so forth. 

Preferably, in the method, the device includes graphical displaying means and 
is operable to display a representation of at least one of the identified objects on the 
displaying means together with one or more of its associated attributes. 

Preferably, in the method, the device includes gr^hical displaying means for 
25 representing said identified objects in a maimer susceptible to interrogation fixim the user by 
way of sculling representation of the idmtified objects. 

Preferably, in the method, said first and second databases are substantially co- 
located in memory of the device. 

Preferably, in the method, at least part of said first and second databases is 
30 provided spatially remotely vinith respect to the device. 

Preferably, in die method, the device is arrange to be operable to present to 
the user objects grouped according to one or more of their attributes. 

Preferably, in the method, the communication device is inoplemented in the 
form of a mobile telqphone. 



PHNL031279EPP 



5 16.10^003 

Preferably, in tiie raetliod, said at least one object conqprises at least one of 
pictures, photographs, movies, standard SMS messages, quotes, words and emoticons. For 
example, contemporary mobile telephones are known to have a "T9" c^pabilily such that, on 
input of a starting letter of a word, the user is presented with a list of words utilizing the letter 
S for the user to select amongst 

According to a second object of the invention, there is provided a 
communication device operable to predict input of electronic objects thereto, the device 
including: 

(a) a first database of electronic objects susceptible to being inserted into 
10 multimedia messages composable on Ifae device; 

(b) a second database of electronic object attributes; 

(c) associating means for establishing one or more associations between at least 
one object of the first database and at least one corresponding attribute of the second 
database; 

IS (d) requestreceivingmeamforreceivingfiomauser of Ifae device a request for 

inclusion of one or more of tiie objects into a multimedia message, said request including at 
least one input argument; 

(e) conqmting means for matohing said at least one input argumsot witii said at 
least one attribute in tiie second database and for identifying one or more objects 

20 conespondiDg to Ifae at least one iiq)ut argument and i . 

(f) displaying means for presenting to the user a display representation of said one 
or more objects corresponding to said at least one argummt. 

The invention is of advantage in that it is enable of addressing at least one of 
the objects of Ifae invention. 
25 Preferably, in Ifae device, said conqnxting means is qperable to present to tiie 

us^ said one or more identified objects in a prioritised manna relative to otiier objects in Ifae 
first database. 

Preferably, tiie device is operable to present said one or more idratified objects 
firstly on flie displaying means to Ifae user in response to tiie request 
30 Prefoably, in tfae device, said conq>uting and said displaying means are 

operable to present said identified objects in an order wherein objects witii most matohing 
attributes to said one or more arguments are pr^ented firstiy in progressive order to those 
objects with least matching attributes to said one or more arguments. 
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Preferably, in the device, at least one of the objects of the first database is 
associated with a plurality of corresponding attributes in the second database. 

Preferably, in the device, said one or more attributes include at least one of: 
(a) relationship of tbe user to one or more intended recipients of the message; 

5 (b) a degree of desired informality of said message; 

(c) chronological time of at one of an instance of generation of the message and 
an instance of despatch of said message; 

(d) ambient conditions of the user ^en composing the message, said conditions 
including at least one of ambient illumination intensity, ambient temperature, ambient 

10 humidity, ambient altitude; 

(e) geographical q>atial location of the user when at least one of cotiq)osing and 
sending the message; 

(Q location of the user according to function of the location; 

(g) a previous histcxry of a preferred selection of said one or more objects 
1 S exercised by the user; 

(h) at least one of a telephone number and a cyberspace address of said one or 
more intraded recq>ients for the message and 

(i) a word already part of the message. 

Preferably, liie device includes position measuring means for dete rmining its 
20 geogr^hical spatial location. More preferably, said measuring means includes at least one of 
an A-GPS and an E-OTD position measuring apparatus. 

Preferably, in order to render the device easier to use, the device is operable to 
relate the geogr^hical spatial location to the us^ location according to tiie location function. 
Location function includes delBnitions such as "home", "work", "ofSce", "fectory", "on 
25 vacation" and so ferth. 

Preferably, the device is operable to display a representation of at least one of 
the identified objects on the displaying means together with one or more of its associated 
attributes. 

Preferably, the device is operable to represent said identified objects in a 
30 manner susceptible to interrogation from the user by way of scrolling representation of the 
identified objects. For exaxnplc, the scrolling presentation is beneficially presented in the 
ferm of at least one of te>ct and icons. 

Preferably, in the device, said first and second databases are substantially co- 
located in memory of the device. Morepieferably, with regard to the device, at least part of 
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said first and second databases is provided spatially remotely with respect to the device. 
Sudi remote provision of the first and second database includes, for example, electronic 
objects downloaded j&om the Internet when composing a multimedia message. 

Preferably, said device is arranged to be operable to jnresent to Hie user objects 
groiqied according to one or more of Ibeir attributes. 

Preferably, said device is iicplemented in the focm of a mobile telephone. 

Preferably, in the device, said at least one object conqirises at least one of 
pictures, photographs, movies, standard SMS messages, quotes, words and emoticons. 
However, it is to be assumed that multimedia messages will usually include text as well as 
one or more aforementioned objects. 

It will be qipredated that features of the invention are susceptible to being 
combined in any coxnbination without departing fixxm the scope of the invention. 

DESCRIPTION OF THE DIAGRAMS 

Embodiments of tiie invention will now be described, by way of example only, 
with reference to the following diagrams whereiti: 

Figure 1 is an iUustration of lists of parametra fiir a communication device, 
the lists being interrelated by mapping functions Fl, F2 andFB; and 

Figure 2 is an illustration ofemoticon and relation lists fix>m Figure land 
cpearation of the mqqiing function Fl; and 

Figure 3 is an illustration of & method of composing a multimedia message on • 
a communication device. 

DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

In overview, the inventor has appreciated that contemporary communication 
devices £acilitating electronic object entry merely provide various lists of characters, for 
exdmple emoticons, whidh device users are capable of selecting according to one or more 
convenimt ^roaches. In consequence, such devices are in practice tedious and slow to use 
when conq)osing multimedia message including one or more objects. In order to address 
such problems, the mventor has identified that it is desirable to arrange for such devices to be 
enable of intelligentiy predicting one or more objects that the users are likely to desire to use 
and presenting such a selection to the users, fliereby reducing an amount of information that 
the users are obUged to process in order to select their preferred one or rnoreolgect^ In 
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particular, the inventor has appreciated that prediction of suitable objects is susceptible to 
being based on at least one of: 

(ai) relationship between a user sending a message and one or more corresponding 

users to whom the message is to be sent; 

(hi) user desire for informal or formal nature of communication; 

(d) measurable parametral afifecting a user sending a message to one or more 

corresponding users, for exan^le one or more of chronological time, ambient illumination 

intmsily, altitude, humidity and/or tempra'ature at which a message is prqpared or ccmq)osed; 

(di) ^graphical location at which a message is being composed; and 

(ei) objects which a user is previously in a habit of using and/or has demonstcated 

a preference to using. 

Such prediction is of benefit in that it is capable of enabling a user of a 
communication device, for exaniple a mobile telephone, to achieve &ster and more 
convenient insertion of eLectronic objects when composing multimedia messages, for 
example EMS or MMS message. 

Thus, the inventor has envisaged a method of enabling mobile telephones to 
predict which electronic objects a user is desirous to insert into a multimedia message. Such 
objects preferably correspond to at least one of an emoticon, a picture, an animation and a 
sound. Moreover, such a multimedia message prefembly corresponds to a contemporary 
EMS or MMS message. 

As an embodiment of the invention, a user actuate abutton of a mobile 
communication device including an associated graphical display, actuation of tiie button 
being operable to trigger display on the display a first part of a list of multimedia objects; the 
objects beneficially resemble insertion of a symbol in a Microsoft Word document 
Alternatively, actuation of the button causes scrolling tfarou^ a list of multimedia objects; 
such objects beneficially resemble insertion of one or more alphabetical character in an SMS 
message as encountered in conten^iorary mobile telephones. 

The present invration will next be elucidated in greater detaiL 

With the advent of enhanced messaging service (EMS) and multimedia 
messaging service (MMS), a user of a communication device, for example a mobile 
telephone, is confronted with a choice of selecting and sending one or more of still pictures, 
emoticons, sounds and animated pictures as objects wh©a conq^osing a multimedia message. 
However, it is found in practice difficult for the user to select amongst numerous objects to 
identify a suitable choice. For exaniple, on a miniature relatively low-resolution pixel liquid 
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crystal display screen as incorporated into many contemporary mobile telephones, often as 
many as fifty pictures as potential objects are listed which takes considerable time fer the 
user to view amongst to select a most appropriate object for a specific desired purpose; for 
example, such a most appropriate object is susceptible to corresponding to an image of a 
S birthday cake with burning candles thereon when a user desires to send a birthday greeting 
text message to another user on the occasion of his/her birthday. In consequence, ^eie Ifae 
user has insufBciat time or patience to review all fifty pictures, tiiere is a probability tiiat a 
picture is effectively selected substantially at random fiom the list Such selection is 
potentially susceptible to subsequent correction which itself represents an inconveni^t and 

10 tedious activity. 

The inventor has appreciated that selection amongst the fifty pictures is less 
litely to be at random or erroneous if die user is jiresented with a predicted list of objects 
which are most likely to be relevant to tiie nature of the message that the user is about to 
prepare and/or cornpose; the predicted list is beneficially considerably shorts than a 

IS corresponding list ofall possible object options. As elucidated in die foregoing, such 
prediction is preferably based on at least one oft 

(%) a relationship between a user sending a message and one or more users 

receiving the message, for example such a user being a fiioid, a motiier, a &ther, an ex- 
marital mistress and so forth; 
20 Qji) a type ofcormnunicatiQn,fi>rexaii9le whether it is ftmnal or informal; 

(Cz) • an instance oftiine at v^ch a message is being conq)osed, for exan^le at 

noQr^ and 

(dz) a geographical location at which the message is con^osed and/or sent, for 

exan^ile from home, fix>m woik, fixim a mistress' house and so forth. 
25 The prediction is optionally susceptible to being also dependent upon other 

&ctors as elucidated in the foregoing. 

Approaches to providing predictable selection according to the invention will 
now be described. 

Referring to Figure 1, there is shown an interrelation arrangement indicated 
30 generally by 10. The arrangement 10 includes an object list 20, a relationship list 30, a time 
list 40 and a location list 50. Other lists are possible, for example a tenq>erature list and a list 
associating degrees of formality/informality to one or more of the objects in the object list 20, 
and a list defining ^5propriate times at whidi one or more of the objects are suitable for 
inclusion in multimedia message. Hie lists 20, 30, 40, 50 are at least one oft 
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(as) pre-programmed into a communication device, for example a mobile 

telephone; 

(ba) downloaded by a user to the device fiom an extemal source such as the 

Internet and/or lap-top computer; and 
S (cs) ii^ut to the device via its data entry &ciHly, for example a keypad a^ 

camera integral to Ifae device. 

The lists 20, 30, 40, 50 are stored in memory of the device, for example as 
volatile and/or non-volatiOle memory, for example flash memory. Items in the lists 20, 30, 40, 
SO are ai^odated by way of functions Fl, F2, andF3. The functions Fl to F3 Ihraiselves are 
10 preferably inoplemented m the device as data fields which are beneficially stored in memory 
of the device, hi a similar manner to the lists 20, 30, 40, 50, one or more of the fimctions Fl 
to F3 are at least one of: 

(a4) pre-programmed into the conmnunication device; 

(b4) downloaded by tibe user to the device from an external source sudi as the 

IS Internet and/or a laptop con^uter; 

(C4) input to the device via its data entry ficilily, for example its key^pad; and 

(d4) fix>m a history of jMcevious associations made by tiic user between the lists 20, 

30, 40, SO, for example as a consequence of composing earlier multimedia messages 

accessing one or more of die lists 20, 30, 40, SO. 
20 Referring to Figure 2, there is shown the function Fl associating specific 

example elements in the lists 20, 30, namely: 

(as) a multimedia message being composed for sending tea Rektion 3 rraults in 

the user being prompted by a display symbol corresponding to primarily an Emoticon 1 ; 
(bs) a multimedia message being coniposed for sending to a Relation 6 results in 

25 the user being prompted by a display symbol corresponding to primarily Btnoticons 2,5; and 
(cs) an Emoticon 4 is presented as a display symbol to praaspt the user when the 

user composes a multimedia message addressed to eitiier a Relation 1 and/or a Relation 5. 

It will be appreciated tiiat, although the user is protcpted by a most appropriate 
subset of objects as detennined by the functions Fl to F3, the user is preferably also capable 

30 of selecting amongst all objects stored in the device if desired although it is appreciated tiiat 
such selection amongst all the objects is potentially tedious as in the prior art The inventors 
have appreciated that such non-specific selection amongst all the objects is likely to be a 
seldom occurrence on account of associated tediousness in situations where the present 
invention is implemented. 
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Tb]2S» v^en composing a multimedia message on liie device, fhe user is 
prompted by a prefenred selection of objects, the selection being detemiined by a selection 
function having a general form as provided in Equation 1 (Eq. 1): 

5 OS = G{R,lMy,z,p,T,F^j) Eq. 1 



wherein 

OS - object selection for display to the user, fi)r example as a graphics icon and/or 

listentr^ 

10 G= an object selection fimction detenniiiing grapMcal informatio 

user vphen con^osing one or more multimedia m^sages, tiie function G having one or more 
of tiie following arguments, the function G giving rise to a grqihic symbol such as a graphics 
icon or list entry presented to the user on a display of the device, the user being cpeiable to 
highlight the icon and/or list entry as desired, thmby instructing the device v^^er or not to 

IS insert the object selected in the mnltimeHift message being conq)osed: 

i= a reference index for a present object being processed by the fimctionG, 

namely each entry in the object list 20 has associated therewith an index value; for exanple 
in Figure 1 a jBrst entry in the object list 20 corresponding to i = 1 is "Emoticon 1 a second : 
entry in the list 20 cotresponding to i 2 is "Emoticon 2" and so on; 

20 R= input data fixmi the relation list 30 together with a relation sele^ ^ 

the user regarding a multimedia message presentiy being conqiosed; 
I = iiqrat data from a user regarding associated formality^nformality grading for 

one or more of the objects in the object list 20 together with an ioformality/formality 
selection made by the user regarding the message presentiy being composed, for example 

25 formal, infonnal and/or business; 

t = iiqrat data fix)m the time list 40 together with a measure of time at which the 

message is being con^osed and/or scheduled to be sent; 

x, y, z spatial location of the user at which the user is composing the message; x, y, z are 
Cartesian co-ordinates defining m^ location and altitude; if required, other spatial defining 
30 paramet^ are susceptible to being employed, for example polar co-ordinates; moreover, fhe 
parameters x, y, z are susceptible to being defined by one or more of A-GPS, E-OTD or 
similai^ as a fiirther alternative, user fiiendly expressions such as "home", "office", "golf 
course", "en route", "abroad" are susceptible to being additionally or alternatively employed 
for defining category of spatial location; 
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p = probabiUty index for displaying flie object associated wifli the flmction G, for 

example on account of this object being frequently selected in the past by the user because of 
personal preference and/or style; 

T = an indication of temperature at which the message being composed is 

5 prepared, for example Ihe parameter T is susceptible to being generated from a temperature 
sensor included wi&in the device so diat summer-relevant objects are more preferably 
presented by the function G at relatively higgler tenq?erature in the order of 30 or higher, 
and 

Fn= association function associating objects in the Hst 20 with parameters of the 

10 olher lists 30, 40, 50 as described in the foregoing witii reference to Figures 1 and 2. 

Thus, during conq)osition of a multimedia message on the device, the fimction 
G is invoked repetitively each time the user is desirous to insert an object into the multimedia 
message. Preferably, the device is operable to search all objects stored therein and only 
forward an indication to the display of the device when a match is identified based on the 
IS arguments of the fimction G in Equation 1. 

Associated with foe relation list is preferably a list of telephone numbers 

and/or cyberspace contact codes. 

Operation of tiie aforesaid device when composing a muMmedia message wiU 
now be described in more detail wifoieferaice also toFigure 3. 
20 The user 160 interfeceswifo foe device man operation state by mdicatingflie 

user's desire to compose a message 1 10. for example by highlighting a "compose message" 
icon on a graphic display 150 of the device. The device foenpionqrtstiie user for details 

such as: 

(ae) ^yhefoer or not foe message to be composed is formal, mfoimal and/or 
25 business; 

(be) one or more iirqposed recipients for the message; 

(cs) an instance oftime at whidi foe message is to be sent and/or at v*ich it is 

composed; and 

(66) where foe user is presenfly located, for exmipl& office, home, en route, abroad; 

30 foiling such entry, the device is preferably operable to determine its position automatically 
160, for example by use of global positioning system (CTS), to detemime its spatial co- 
ordinates and then referring to foe location list 50 to determine a suitable argument for hqrat 

to foe fonction G 100. 
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It will be appreciated in (a6) and (b6) above that it is also possible that a 
telephone number is already associated with a type of communication, namely a priori; 
namely, earlier information may already exist to determine whether a message to a defmed 
recipient is formal or informaL 

Once having entered relevant data in (ae) to (de) above, the user 1 60 then 
inputs text of the multimedia message 1 10« At one or more points within the messa^ being 
composed, the user 160 indicates a desire to include an object by invoking an "object insert" 
function, for exanq)le by higihlig^ting an appropriate corresponding graphics icon on the 
display 150 of the device. The device then invokes the function G, namely 100, repetitively 
to scan through prefmbly all objects present within a database 130 of the device as entered 
earlier 1 20, and if required external objects available to the device for exan^le fiom a 
telephone wireless network provider, and select those objects for which there is a matoh, for 
example: 

(a?) a given object fix>m the list 20 has by way of the flmctionFi^ 

the list 30 which matches said one or more proposed recipimts for the message in (ae) above; 
(by) the user 160 has not yet specified one or more proposed recipimts in (ae) 

above but nevertheless has indicated to the device that a busmess message is desired to be 
conqiosed; and 

(o?) the user 160 is m a habit of very firequently invoking a particular object,!for 

exanqile a compaiqr logo vrtiere the user 160 is a sales representative making representations 
to potential fixture clients, the device therefiire including such a popular object for the user 
1 60 to select even though not directly normally associated with the one or more intended 
recipients specified by the user 160. 

TheusCT 160 selects one or more objects fix)m the list presented on the display 
150 of the device and continues, if required re-invokmg the function G 100 for further objects 
to be included at other parts of the message, before finally indicating to the device that the 
message should be sent to the one or more proposed recipients. 

Thus, the function G 100 is enable of sorting by way o^ for exanq)le, spatial 
location, object, relation^bip, type of communication such as informal/formal/business, 
although other modes of sorting are also preferably accommodated 

The aforementioned device according to the invention is susceptible to 
including the following preferable futures: 

(ag) the device is capable of estimating its own position, for example by way of A- 

GPS, E-OTD and by way of related position detennining &cilities; 
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(bs) the user and/or the device are capable of ms^ing different geogr^hical 

locations against different real-life places such as "OfiBce", "Home", "Favourite Club", 
"Favourite Drinking Bar". Such association of spatial location to location fiinction is 
jwreferably executable by the user 160 manually or via access to an external network to the 

5 device, for exan^le the Internet; 

(cs) the user 160 in the device database 130 is able to map different telephone 

numbers and/or e-mail addresses to different real-life "number-relationships - type of 
communication" classes by way of fimctions similar to the aforementioned functions Fl to 
F3; for example, number-friend-fbnnal", "number-fiSend-informal", "number-customer- 

10 formal", "nnmber-business^partner-foimal-business"; 

(ds) on the display ISO, operating software of the device driving the display ISO so 

that one or more objects, for example one or more emoticons, fix)m tihe list 20 displayed, at 
least in abbreviated form symbol format, on the display 1 50 for the user 1 60 to select are 
ta^ed so as to identify to the user 1 60 whether or not it is a formal picture, an informal 

IS picture, a business picture or an emoticon; 

(69) in a similar manner to (ds) , one or more of the obj ecte in the list 20 are 

susceptible to being tagged only with a relationship fit)m the list 30. For 6Kample» an 
emoticon depicting a dancing monkey can be tagged as being a "Mend icon". Thus, an 
object in the form of a picture is susceptible to being tagged as "picture-fiiend" or "picture- 

20 formal" for single argument relationships or even "picture-friend-formal" for multiple 
argument relationships; 

(i^) the device is preferably arranged to siqsport an abbreviation syntax on the 

display 150, for exanqple "9856712536 -f -i" ^Aere an argument "f denotes a friend's 
telephone number and an argument "i" denotes that communication to the number 

25 9856712536 is of an informal nature; in consequence, wbiSEL the user 160 is composing a 
multimedia message for this friend, the user 160 is presented on the display primarily with 
objects from the list 20 which are designated at entry 120 to be of an informal nature. 
In order to further elucidate the present invention, a specific sinq>le exanq^le ernbodiment of 
the invention will be described. 

30 The user 160 is at his/her house and is desirous to s^id a multimedia message 

to his/her friend using the communication device; for exanople, the device is inq)lemOTted in 
the form of a mobile telephone. A spatial location of the user 160 and his/her associated 
device is estimated either by a user schedule 120 ixsput earlier to the device, or by using 
positioning techniques such as, for example, A-GPS. 
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In a fiffst step, the user 1 60 selects a telephone number corresponding to a 
fiiend. Such a selection causes the device via its function G 100 to present on the display 
150 those objects in the list 20 stored in the database 130 which are tagged by one or more 
fimctions F to be informal. The objects presented are preferably displayed in concise form to 
fecffitate easily scrolling on the display 150. Moreover, on the display 150, objects being 
tagged by the aforementioned functions F as being "friend" and "infonnal" are displayed 
first, followed by objects tagged as being "fiiend" but without fonnaUty tagging, followed by 
objects tagged as being "informal" but without relation tagging set 

In a second step, the user 160 selects fix)m flie sorolled list, tfamby inserting 
the coiresponding selected object into the nmltimH^a message. 

In a third step, when the message has been completed, the user 1 60 proceeds 
to send tiie message to fliefiiend. Moreover, the fiiend subsequently opens the e-mafl and 
reads the multimedia message including its various associate objects, for example one or 
more of aforementioned emoticons, pictures, photogr^hs. movie clips and so forth. 

It wiU be appredated that embodiments of the invention described in 
foregoing are susceptible to being modified without departing j&om the scope of the 
invention. 

In defining relationships in the foregoing, a logical relation sequence is 
preferably of a form where defined objects (OBJ) may be used with defined relations (REL) 
may be used in defined types of communication (TYP) may be used in defined telephone 
numbers (NUM), nanpely symbolically in a manner: 

OBJ <=> REL <=> TYP o=>NUM 

In ttie foregoing, expressions such as "comprise", "incorporate", include", "contain" are to 
construed to be non-exclusive, namely allowing far fbo presence of other part or items not 
expUcitly disclosed. *Coniputer program' is to be understood to mean any soflware product 
stored on a computer-readable medium, such as a floppy disk, downloadable via a network, 
such as the Internet, or maricetable in any other manner. 
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CLAIMS: 



1- A method of piedicting input of electronic obfects in a cQmrnunication device, 
the method including the steps of: 

(a) establishing a first database of electronic objects susceptible to being inserted 

into multimedia messages composable on the device; 
5 (b) esta bli s hing a second database of electronic object attributes; 

(c) establishing one or more associations between at least one object of tiie first 

database and at least one corresponding attribute of flie second database; 
(4) receiving fix)m a user of the device a request for inclusion of one or more of 

the obfects into a multimedia message, said request including at least one input argument; 
(®) matching said at least one input argument with said at least one attribute in flie 

second database and thereby identifying one or more objects corresponding to the at least one 
inpiat argument and its associated at least one attribute; and 

presenting to the user a display representation of said one or more objects 
corresponding to said at least one argument 

15 

2- A method according to Claim 1, wherein said one or more identified objects 
fix)m step (e) are presented in a jirioritised manner relative to other objects in the first 
database. 

20 3- A method according to Claim 2, wherein said one or more identified objects 

fix)m step (e) are presented firstiy to the user. 

A method according to Claim 1 , wherein said one or more identified objects 
fix)m step (e) are presented in an order wherein otg ects with most matehing attributes to said 
25 one or more arguments arc presented firstiy in progressive order to those objects wifli least 
m at chi n g attributes to said one or more arguments. 



5. 

least one of: 



A n[iethod according to Claim 1, wherein said one or more attributes include at 
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(a) relationship of the user to one or more intended recipients of the message 

(b) a degree of desired informamy of said message; 

(c) chronological time of at least one of an instance of generation of the message 

and an instance of despatch of said message; 
5 ambient conditions ofihe user when composing the message, said conditions 

including at least one of ambient illunaination intensity, ambient t^erature, ambient 
humidity, ambient altitude; 

(e) geogr^hical spatial location of the user when at least one of composing and 

siding die message; 
10 (f) location affile user according to function of tiie location; 

(g) a previous history of a preferred selection of said one or more obj ects 
exenasedby tibe user, 

(h) at least one of a telephone number and a cyberspace address of said one or 
more mtended recipients for the message and 

15 (i) a word ahea^ part of flie message. 

6. A method according to CUdm 1, wherein the device includes position 

measuring means for determining its geogr^cal spatial location. 

20 7. AmethodaccordmgtoCaahnl.whereinfliedevicemcludesgr^hical 
displaying means for representtog said identified olqects m a manner susceptible to 
interrogation from the user by way of scrolling representation of the identified objects. 

8. AineflMdaccordingtoCIaiml,whereinthedeviceisariangedtobeqperable 
25 to present to flie user objects grouped according to one or more thdr attributes. 

9. A computer pro gram product emibUng a progcammahle device to perform a 
method as claimed in claim 1. 

30 10. A communication device operable to predict iiqrat of electronic objects 

tiieieto, die device including: 

(a) a first database of electronic objects susceptible to being inserted mto 
rpnirimftHia messages composable on the device; 

(b) a second database of electronic object attributes; 
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(c) associating means for establishing one or more associations between at least 

one object of the first database and at least one corresponding attribute of the second 
database; 

request receiving means for receiving &om a user of the device a request for 
inclusion of one or more of the objects into a multimedia message, said request including at 
least one input argument; 

(e) computing means for matching said at least one input argument wilii said at 

least one attribute in the second database and for identifying one or more objects 
corresponding to the at least one iiqiut argument and its associated at least one attribute; and 
(Q displaying means fiir presenting to the user a display rqpresentation of said one 

or more objects corresponding to said at least one argument 
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ABSTRACT: 



There is ]irovided a method of predicting input of electronic objects in a 
communication device. The method includes the steps of: 

(a) establishing a first database of electronic objects susceptible to being inserted 

into multimedia messages composable on the device; 
S (b) establishing a second database of electronic object attributes; 

(c) establishing one or more associations between at least one object of tiie first 
database and at least one corresponding attribute of the second database; 

(d) receiving firom a user of the device a request for inclusion of one or more of 
the objects into a multimedia message, said request including at least one input argument; 

10 (e) matching said at least one input argument with said at least one attribute in the 

second database and thereby identifying one or more objects corresponding to the at least one 
input argument and its associated at least one attribute; and 

(Q presenting to the user a display representation of said one or more objects 

conesponding to said at least one argument 

15 

Fig. 3 
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